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INTRODUCTION 



^is is a report on the preliminary findings of a study designed to 
assess the validity and utility of the Anne(^ Services Vocational Aptitude 
Battery (A.S.V^A.Bj in predicting the academic success of students enrolled 
in the Automotive Service Specialist curriculiin, a two-year A.O.S. degree 
program offered at the School of Vocational Styidies of the State University 
of New York Agricultural and Technical College jat Alfred, New York. The 
primary o]^jective of this two-part study is to (investigate systematically 
and statistically the relationships between stulient performance on the 
A.S.V.A.B* \and their performance within the automotive curriculum, with a 
view toward, assessing the potential of the A.S.'^.A.B. for predicting the 
probability of* student attrition as well as the i^egree of academic achieve- 
ment. 

\ 

While pkrt Two of this report will address itself to the exploration 

— 1 I 

of the nature ^nd magnitude of the variety of relationships suggested above, 
the concern her,e is simply with a description^^fff^he relative performance 
of selected subgroups of Automotive Service Specialist student^^n the 
A.S.V,A^B, Specifically, we are interested in comparing the performance of 
Entering. Freshmen, Continuing Seniors, and B.O.C.E.S. Graduates (those 
studentJS who participated in the Summer, 1975 "B.O.C.E.S. Advanced Standing 
Program") with one another and with Regional and National Norms. 

^ Presentation aiid discussion of the findings is preceded by brief 
d^criptions of ^ the test instrument, the student sub-groups, and the test- 
administration/ an^ data analysis processes. 



THE A.S.V.A.B. 



Available through the United States Department of Defense, the Armed ' 
Services Vocational Aptitude Battery is a battery of nine standardized, 
group-administered, and timed tests, which is designed to measure certain 
vocational skills and knowledge, and which appears to exhibit acceptable 
levels of reliability and validity.-^ The nine tests are identified and 
described briefly as^^Mlows:^ 

1^ Coding Speed Test (CS)^ This is a test of clerical 
speed and accuracy. At the top of each test page 
is a group of words with a code niomber beside each 
word. Each test item consists of one of the key 
words from the top of the page, followed by five 
code numbers. The examinee's task is to identify 
the correct code number for that word in accordance 
with the code at the top of the pa.ge_^The test 
emphasizes speed; the examinee is given lOO such 
items and is required to accurately complete as 
many as possible in seven minutes. 

2. Word Knowledge Test (WK) • This test prffi^nts 25 
vocabulary words. Each of the vocabulary words is 
contained in a sentence and is^ followed, by four 
alternative answers. From among the four alterna- 
tives, the examinee must select the word which means 
most nearly the same thing as the underlined word in 
the item stem. In this and all stibsequent tests in 
the battery, speed is not emphasized; while there is 
a time limit on the tests, it is ample for most 
examinees. 



3. Arithmetic Reasoning Test (AR) . This test presents 25 
reasoning problems involving arithmetic processes. For 
each problem, the examinee must solve the problem and 
select the correct answer from among four alternatives. 

^See, for example, Harry D. Wilfong, R. J. Armstrong, and R. K. Huckell, Jr. 
Percentil e N ormative Tables for the Armed Services Vocational Aptitude 
Battery (1973-74 School Year Base ) , Randolph Air Force Base, Texas: Research 
Division Armed Forces Vocational Testing Group, December, 1974; and Randolph 
K. Harris and R. K. Huckell, Jr., Predicting Academic Success in Secondary 
Schools from the General Technical Composite on the Armed Services Vocational 
Aptitude Battery , Randolph Air Force Base, Texas: Research Division Armed 
Forces Vocational Testing Group, December, 1974. 

^The Test and Aptitude Area descriptions which follow are taken from. Armed 
Forces Vocational Testing Group, Counselor's Manual Volume I ASVAB , Universal 
City, Texas; Armed Forces Vocational Testing Group, 1974. This manual also 
contains data on reliability and validity of the A.S.V.A.B. 



4. Tool Knowledge Test (TK) • This test has 2S pictorial 
questions about tools and equipment. "Jlacn item presents 
a picture of a tool or piece of equipment, , followed by 
four more drawings of various tools or pieces of equip- 
ment. The examinee must select the one of the four 
alternatives that "goes best" with the stem. 

5. Space Perception Test (SP) . This is also a pictorial 
test. It consists of 25 items, each of which shows a 
flat pattern followed by four drawings o^ three- 
dimensional figures. Broken lines on the pattern show 
where it is to be folded. The subject's task is to 
select the one of the three-dimensional figures which 
could be made from the pattern by folding it on the 
dotted lines. 

6. Mechanical Comprehension (MC) . This is a 25 item test 
in which a drawing illustrates a mechanical principle 
and a question is asked about it. The correct answer 
must be selected from four alternatives. 

7. Shop Information Test (SI). In this test, about half 
the items contain drawings. The test consists of 25 
questions about shop practices and the use of tools. 
The examinee is to select the correct answer from among 
four alternatives. 

8. Automotive Information Test. (AI) . This test ha^^ ^5 

- - ■ ■ ■ . . V - 

questions about automobile parts or their operation; 

The correct answer must be selected from four alternatives. 

9. Electronics Information Test (EI). This test consists 
of 25 questions involving elementary principles of 
electricity and electronics. The examinee must select 
the correct answer to each question from among four 
alternatives. 

Selected combinations of scores on eight of i^he tests are used to 
define and measure five "composite" scores relating to the following Aptit 
Areas: 

GENERAL/TECHNICAL— describes the student's ability, for 
occupations requiring academic ability. The composite i9 composed, 
of verbal and mathematical components of the battery. 




■ CLERICAL/ADMINISTRATIVE— de^fiKes the student's ability 

relevant to clerical and dSministrative occupations. The 

composite is composed of the battery components concerned 

with verbal ability and clerical speed an(3 accuracy ♦ 

C 

ELECTRONICS — describes student's ed>ility relevant to elec- 
trical and electronic occupations. The composite consists 
of tests dealing with electrical information and with 
understanding of mechanical principles. 

GENERAL MECHANICS — describes student's ability in terms of 
"those capabilities relevant to a variety of mechanical and 
trade jobs. The composite "consists of tests assessing shop 
infozination and spatial ability. 

MOTOR MECHANICS — describes the student's ability relevant 
to engine repair and other related jobs, is composed 

of measures of automotive information and \inder standing of 
mechanical principles. 



Administration and scoring of the A.S.V.A.B. are services provided 
by the Department of Defend at no cost to participating institutions, and 

a normative base has been developed which allows an institution to compare 

/ 

its students' scores with Regional and National Norms. Norms by sex are 
available for grades 10, 11, and 12, and, while post-secondary norms are 
being developed, the size of the available post-secondary normative base 
is too small currently to allow meamngful comparisons. " 



THE STUDENT SUBGROUPS 



s 0 



A total of 211 of 217 Automotive Service Specialist students took 
part in this study. Of those participating, 116 were Entering Freshmen, 
78 were Continuing Seniors, and the remainder were studert£s enrolled in a 

novel ' time -shortened degree program involving the New York State Board of 

\ 

Coopeirative Education Services (B.O.C.E.S. ) . This latter sub--group con- 
sist^d of 17 of the 22 students who participated in the Summer, 1975 
"B.O.C.E.S. Advanced Standing Program." The program, which is currently 
in the pilot stage, is designed specif ical^ly for the two-year B.O.C.E.S. 




graduate. It involves an eight -week summer school at the College, which, 
together with the prior B.O.C.E.S. training, is intended to substitute for 
the freshman year of the Automotive Service Specialist A.O.S. program. Of 
the 17 B.O.C.E.S. students taking part in this study, 15 had been success- 
ful in completing the summer school and held senior status, while 2 had 
been unsuccessful and were registered as freshmen. 

THE TEST ADMINISTRATION AND DATA ANALYSIS 

On September A, 1975, the A.S.V.A.B. was administered to the 211 
Automotive Service Specialist students in a group and timed situation at 
the College's School of Vocational Studies' Cam^i^s in Wellsville, New York. 
The administration, lasting approximately *two'and one-half hours, was over- 
seen by a United States Army Sergeant, who had had expert knowledge of and 
extensive previous experience in administering the A.S.V.A.B. 

The Test and Aptitude Area scores of the 211 students were receive^, 
in the College's Office of Institutional Research by September 30, 1975. 
The anal^^sis of these data was facilitated by the assistance of the Director 
of the Computer Center, who wrote and ran the program for the calculation 
of the means and standard deviations. 



\ 



FINDINGS \ 

Comparison with Normative Groups , ^^vT" 

Table 1 displays the means and standa;^ deviations for the three 
student subgroups and for the Regional and National Normative Groups. 
Since detailed comparisons among the Automotive Service Specialist student 

■/ 

subgroups are the subjects .qf^subsequent tables, our observations here are 

8 



restricted to comparisons with the Regional and National Norms. In that^ 
regard, we note that, compared with both Regional and National Normative 
Groups, students enrolled in the Automotive Service Specialist curriculum 
show average scores which are: 

la. Somewhat lower on the Coding Speed Test? 

2a. Approximately equal on the Arithmetic Reasoning Test? 

3a. Somewhat higher on the Word Knowledge and Space Perception Tests; 

4a. Notably higher on the Tool Knowledge, Mechanical Con\prehension, 
Shop Information, Automotive Information, and Electronics Infor- 
mation Tests; 

and 

lb. Notably higher on the Aptitude Areas of CLERICAL/ ADMINISTRATIVE 

and GENERAL TECHNICAL; 
2b. Dramatically higher <^n the Aptitude Areas of ELECTRONICS, MOTOR 

MECHANICS, and GENERAL MECHANICS. 

Comparison of B.O.C.E.S. Graduates with Con^ipuing Seniors 

Substantial similarity in Test and Aptitude "^Aj;^a scores between 
B,.O.C.E.S. Graduates and Continuing Seniors is suggested )^ the data of 
Table 2. Interestingly, in three of the Tests and in Two of^^e^ Aptitude 
Areas B.O.C.E.S. Graduates show average scores which are somewhat higher 
than those for the Continuing Seniors. Only two of the mean differences 
cire statistically significant, however, those for the Tool Knowledge and 
Shop Information Tests. * 

Comparison of B.O.C.E.S. Graduates with .Entering Fre^hn\en 

The statistics of Table 3 reveal that the B.O.C.E.S. G^a^uates 
score significantly higher than the Entering Freshmen on 5 out of 9 / 
Tests and 3 out of 5 Aptitude Areas. The evidence strongly suggests ' 

ErJc . 9 



. / 

the superiorit:^^^ of B.O.C.E.St Graduates participating in the time-shortened 
degree program with respects to Tool Knowledge, Mechanical Comprehension, 
Shop Information, Automotive Information, and Electronics Infoarmatibn* 
Similarly, they show significantly higher than average scores in the ELEC- 
TRONICS, MOTOR MECHANICS, and GENERAL MECPiANICS Aptitude Areas • 

Comparison of Continuing Seniors with Entering Freshmen 

The data of Table 4 reveal that the Continuing Seniors score signif- 
icantly higher than the Entering Freshmen on the Mechanical Comprehension, 
Automotive Information, and Electronics " Information Tests, and in the ' , 
ELECTRONICS and MOTOR MECHANICS Aptitude Areas. 
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Tcible 2: Comparison of the Performance of B.O.C.E.S. Graduates yith that of 

Continuing Seniors on the Armed Services Vocational Aptitude Battery 
(A.S.V.A3.) f Expressed in Terms of Mean Differences (X2^-X2) and 
Results of Appropriate Two-Sample t-tests. 



A.S.V.A.B. Tests 
And 



Average Scores of 
B.O.C.E.S. G^huates 



Significance 



Degrees of 
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mnus /werage ocores 
of Continuing Seniors 


jjevexs ana 


TPv" ^ A 

r rscuOm 


Tests 


/ 

/■ 






Coding Speed 


1.5' 


Not Significant 




Word Knowledge 


^ .1 


Not Significant^ 






^ -1.5 


Noi" Sianificant 




Tool Knowledge 


1.9 


.05 


27 


Space Perception 


.2 


Not Significant 


• 


Me'ch. Comprehension 


•4 


Not Significant 




Shop Information 


1.8 


.01 


26. 


Automotive Infor. 


.1 


Not Significant 


• 

* 


Electronics Infor. 


- .6^ 


Not Significant 




APTITUDE AREAS 






- 


ELECTRONICS 


-1.3 


Not Sigrvificant 




MOTOR MECHANICS 


.5 


Not Significant 


I 


GENERAL MECHANICS 


4.5 


Not Significant 




CLERICAL/ADMIN. 


2.6 


Not Significant 




GEN^rl^ TECHNICAL 


-4.5 


Nat'^lgni f icant 
• 




\^A11 are two-tailed tests 
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Table 3: Cofepari;5on of the Performance of B.O-C.E.S. Graduates with that of 
Entering Freshmen on the Armed Services. Vocational Aptitude Battery 
(A.S*V.A.E.») ^ Expressed in Teinns of Mean Differences i^i''^2^ 

- ^ Results of Appropriate Two-Sample t-tests. 



A.S.V.A.B. Tests 
And 

Aptitude Areas , 



Average Scores of 
B.^.C.E.S. Graduates 
Minus Average Scores 
of 'Entering Freshmen 

^1"" ^3 



Significance Degrees of 

. and 

Le VjB Is Fr e edom 



\ 



Coding Speed 



Word Knowledge 



zoning, 



AritJ^unetic 
^ ^^A. Knowledgev\ 
l^'Space Perceptipnv 
' Mech. Comprehension 
Shop Information 
'Automotive Infor 
Electronics Infot 



^ea5^ 




APTITUDIS AREA; 

ELECTRONICS - 
MOTOR MECHANICS 
GENERAL MECHANICS 
CLERICAL/ ADMIN/ 
GENERAL TECHNICAL 




Not jgjiJ^hrf icant 
Not Significant 
Not Significaint 
.005 

Not Significant 
^ .025 
.0005 
^ . 0005 
<^ .05 



• ^ .01 
.0005 
.01 

Not Significant 
Not Significant 



"^All are one-tailed tests (H^-/^/^^/^^' 



32 

32 
26 
38 
26 



36 
80 
, 30 



Table 4: Comparison of the Performance of Continuing Seniors with that of 

Entering Freshmeiyon the Armed Services Vocational Aptitude Battery*" 
(A.S.V.A.B.) , Expressed in Terms of Mean Differences (X2-X3) and* 
Results of Appropriate Two-Sample t-tests» 



A.S.V.A,B. Tests^ 
And 

Aptitude Arfeas 



Average Scores o^ 
Continuing Seniors 
Mfhus Average Scores ^ 
of Entering Freshmen 



Significance 



Levels 



and 



Degrees of 
Freedom 



Rests 



Codiiig Speed 
<ord Knowledge - 
Arithmetic Reasoning 
Tool \:nowledge 
Space Perception 
' Mech. Comprehension 
Shop InfozTnatjaon 
Automotive Infor. 
Electronics Infor. 



1.1 
.3 
.6 
.3 

0 

1.3 
.5 
2.8 
2.3 



Not Significant 
Not Significant 
' Not Significant 
Not Significant 
Not Significant 
.005 

r Not Significant 
.0005 



.0005 



120+ 

120+ 
120+ 



APTITUDE AREAS 
ELECTRONICS 
MOTOR MECHANICS 
GENERAL MECHANICS 
CLERICAL/ADMIN. 
GENERAL TECHNICAL 



8.1 
6.2 
1.8 
3.7 
3.0 



.0005 

I 

.0005 
Not Significant 
Not Significant 



Not Significant 



120+ 
114 



''All' are one-tailed tests (H^^: /^^K/^S ^ * 




MMARY AND CONCLUSIONS . > 
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\ 
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The findings of this study provi^^^ncouraging though general and 

t » ■* 

indirect evidence for the utility of the A.S.V.A.B. in predicting the prob- 
ability of success in automotive service studies. Compared with Regional 
and National. Normative Groups\ students enrolled in the Automotive SerUice 

V 

Specialist curriculum showed notably and even dramatically higher scores 
on the "mechanical-automotive-electronics" Tests and Aptitude Areas\. 
Furthermore, .on this same^ "mechanical-automotive-eleatronics" cluster, 
the A.S.V.A.B. appears to exhibit an ability to discriminate among cate- 
gories of students having different levels. of academic training in automo- 
tivje studies. For examp!|.e, while the B.O^C.E.S. Graduates participating 

•■ ■ J 

in the time-shortened degree program shcrt^ci scores which were approximately 
equal to the Continuing Seniors, both of the^ subgroups scored significantly 
higher than the Entering FreshmVi on the "mechakical-automotive-electronics" 




Tests and Aptitude Areas. ^-.^ 

In Part '^wo of this study, the utility of the A.S.V.A.B. in predicting 
the probability of student attrition and the degree of academic achievement 
will be assessed more specifically and directly as interrelationships among 
Test and Aptitude Area scores and student grade averages are examined using 
regression and correlation techniques. 
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STATISTICAL NOTE 



For all t-tests employed in this study, it was assvuned that ^ ^ 

\ 

ThusV the standard error the difference between sample means was calcu- 




^See Hubert M. Blalodl^jMr • , Social Statistics , (second edition), New York: 
McGraw-Hill Book CompMy, 1^72, pp, 226-227^ 



